The Quantum Theory of MIMO Markovian Feedback with Diffusive Measurements 
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Feedback control engineers have been interested in MIMO (multiple-input multiple-output) ex- 
tensions of SISO (single-input single-output) results of various kinds due to its rich mathematical 
structure and practical applications. An outstanding problem in quantum feedback control is the 
extension of the SISO theory of Markovian feedback by Wiseman and Milburn [Phys. Rev. Lett. 
70, 548 (1993)] to multiple inputs and multiple outputs. Here we generalize the SISO homodyne- 
mediated feedback theory to allow for multiple inputs, multiple outputs, and arbitrary diffusive 
quantum measurements. We thus obtain a MIMO framework which resembles the SISO theory 
and whose additional mathematical structure is highlighted by the extensive use of vector-operator 
algebra. 

PACS numbers: 42.50.Dv, 42.50.Lc, 42.50.Pq 



I. INTRODUCTION 

Feedback control engineering flj] is ubiquitous in mod- 
ern technology 0, Si- -^s we further miniaturise tech- 
nology, a quantum theory of feedback control can be ex- 
pected to be essential 141,1511. In fact the realisation that 
quantum technology may benefit from modern control 
theory is currently driving a research program in which 
concepts from classical control systems [Q, i7| are being 
applied and extended to quantum systems [8j-|l8|. This 
facet of quantum feedback control makes it an interdis- 
ciplinary field, attracting both engineers and physicists. 

A control strategy that has been widely studied is 
Markovian feedback [Sl which has useful applications in 
quantum information [20l425| . This is a continuous (in 
time) process which can be briefly summarized by Fig. [T] 
A general framework for such a process when the system 
has only one measurement output, one feedback input 
(Fig. IHa), a case which we refer to as single-input single- 
output, abbreviated to SISO), mediated by homodyne 
detection was first put forth by Wiseman and Milburn 
[26j . In that work they treated feedback as an instanta- 
neous process. A more detailed treatment that showed 
how to account for a feedback delay and how the limit 
of zero delay should be appropriately taken, giving rise 
to Markovian system evolution, was later given by Wise- 
man [23l . This is the most complete theory of Markovian 
feedback developed to date. 

A theory of MIMO (multiple- input multiple-output. 
Fig. Qlb)) quantum feedback would be necessary in any 
situation where multiple degrees of freedom of a quan- 
tum system are monitored and controlled. The system 
could be a register of qubits, or the different canonical 
momenta (or positions) of a system of quantum objects. 
Indeed, investigations in this direction with a few inputs 
and outputs have already begun [28l - l32| . With the 
drive to build realistic quantum computing devices where 
quantum information would be encoded in many qubits 
a general theory of MIMO control would be an valuable 
tool to obtain. 



The extension of Ref. [27] to multiple inputs and mul- 
tiple outputs would seem to be the obvious follow-up so 
it is natural to ask why this generalization was not made 
until now. There are two reasons for this. The first is 
related to the strategy underlying a master equation ap- 
proach to open systems — Changes in our distinguished 
system due to its interactions with other ancillary quan- 
tum systems are taken into account by including, in the 
master equation, parameters (numbers) which character- 
ize these ancillary objects. The measurement step in the 
feedback loop shown in Fig. [T] then defines a necessary 
point of interaction between the system and the measur- 
ing device. A mathematical representation of the mea- 
surement is therefore necessary; without it a master equa- 
tion for the controlled system cannot be derived. Finding 
this mathematical representation is nontrivial and it was 
not until 2001 that a representation of diffusive measure- 
ments with unit detection efficiency was found [ssj . The 
end result is a parameterization called the unravelling 
matrix, generalized in 2005 to include non-unit detection 
efficiency [l9| . In this paper we will use a different pa- 
rameterization (which we have referred to as the M-rep 
[s^ ]) because our results are simpler when expressed in 
terms of the M-representation of diffusive measurements. 

The second reason for not extending the SISO work 
of Ref. [27j to multiple inputs and multiple outputs ear- 
lier was due to a lack of motivation. The aforementioned 
research program of finding quantum-mechanical paral- 
lels of classical control has only proliferated in recent 
times j60| . The physics and engineering communities at 
the time of Ref. ^3] were more or less separated and 
terms such as "MIMO" and "nonlinear systems" did not 
mean much to physicists. Control engineers have long 
been interested in generalizing various SISO results to 
the MIMO case, due to both its mathematical structure, 
and the prospects of practical applications that MIMO 
systems can offer |38l - l43| . It remains to be an active line 
of research today in the engineering community [44- 47] . 
So a second motivation for constructing a MIMO theory 
of feedback is to allow quantum control to benefit from 
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FIG. 1: Markovian feedback in the case of (a) SISO, and (b) 
MIMO. Note the number of bin fields is not part of the def- 
inition of MIMO. For generality we will take there to be L 
such inputs. We take the environment to be a collection of 
(bosonic) harmonic oscillators. The system interacts with the 
bath field bin and this process turns bin into bout which then 
gets detected. Here we are defining an A'^-component vector- 
operator (vop) a as a = (01,02, . . . ,ajv)^ (see Appendix A 
of Ref. [3JI). The detection process produces a current, mod- 
elled by yi, which is then fed back into a feedback actuator. 
The actuator uses the information in the measured current 
to implement a control u on the system. The measurement 
ouput yi is usually referred to as just the "output" and the 
control vop u as the "input" . It is possible to allow the num- 
ber of outputs be different to the number of inputs, but for 
simplicity (and without loss of generality, see Appendix|X| we 
will let these be the same, equal to R. Markovian feedback 
may then be defined by u = yi- 



the works of engineers, and more generally, aid in the 
broader program of drawing analogies between classical 
and quantum theories of feedback control. 

The paper is organized as follows: In Sec. |TT] we in- 
troduce the theory of quantum measurements in the 
Heisenberg picture and discuss how such a model can 



be extended to include feedback. This theory is then 
used immediately in Sec. IIIII to describe the uncondi- 
tional evolution of the system by deriving the Marko- 
vian MIMO feedback master equation and the Markovian 
quantum Langevin equation. There are two well-known 
approaches to obtaining these results and they are both 
discussed in Sec. IIIII In Sec. IIVI we consider time evolu- 
tion with conditioning. The MIMO stochastic feedback 
master equation and two-time correlation function of the 
measured current are derived in this section. In Sec. |V] 
we show how our theory of MIMO feedback correctly re- 
produces previously known results in the limiting cases of 
homodyne- and heterodyne-mediated feedback. We then 
conclude with a discussion in Sec. IVll 

At this point we would like to refer the reader to our 
exposition of vector-operator (or vop) algebra in the ap- 
pendix of Ref. [34] as this is used extensively in this pa- 
per. We also mention that for convenience we will not 
necessarily reflect the multi-component nature of vectors 
or vops in our language when they are referred to, such 
as in "the field a", or, "the current y", as opposed to 
using plurals as in "the fields a" or "the currents y" . 



II. REVIEW OF HEISENBERG-PICTURE 
DYNAMICS 

A. Open Quantum Systems 

To set the premise of our theory we refer to Fig. [1] but 
in the absence of the feedback actuator (i.e. u = 0). The 
system and environment can be considered as one closed 
system whose time evolution is described by 

H = Ho + Hi+Hn., (1) 

where Hq consists of the free Hamiltonians for the sys- 
tem and bath. Evolution due to external driving, or, for 
example, the extra Lamb shift that is often dropped in 
quantum optics Q are accounted for by Hi. The en- 
vironment is assumed to be a free bosonic field in one 
dimension (i.e. specified by a space-time coordinate) in 
the vacuum state and the system interacts with the en- 
vironment by exchanging energy quanta with the bath 
field. We model this by the coupling Hamiltonian 

H^^i{hlc~c^h,n) ■ (2) 

where c and bin are each an L-component vop and the 
Hermitian conjugate of an iV-vop A is defined by 

At = (it,it^...,ij^) . (3) 

Note that our measurement is performed on the bath, so 
within the standard quantum theory of indirect measure- 
ments [igj the environment acts as our measuring appa- 
ratus and ([5]) effects a measurement interaction. The field 
bin(t) represents quantum noise and o?Bin(i) = hi^it) dt 
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is a quantum Wiener increment fs^. That is it has zero 
mean 

(dB^t)) = , (4) 

and satisfies the (quantum) Ito rule 

dBin{t)dBl{t)^hi^dt, (5) 

with all other second or higher moments negligible. We 
are denoting an L x L identity mop (matrix-operator, see 
Ref. [3^]) by 1^. The dynamics due to Hq is usually well 
known and we can simplify matters by first transforming 
to a frame rotating at a frequency set by Hq and sub- 
sequently define all time evolution with respect to this 
frame. Unless required we will generally omit the time- 
dependence due to Hq and define our Schrodinger and 
Heisenberg pictures with respect to the rotating frame 
defined hy Hq 0- 

For simplicity we group Hi with to define the 
time-evolution operator due to "measurement" by the 
Hudson-Parthasarathy equation [si'] 

hdUn^{t,to) = {-iHidt-\ c^cdt 

+ dBlc~cUBi,,)Um{t,to) , (6) 

where Uni{ta,to) = i. 

As a consequence of the singluar nature of bin, the 
unitary evolution specified by (|6]) gives rise to an output 
field in the Heisenberg picture 

dBout(i) = UUt + dt,t) dBin{t) Ura{t + dt,t) , 

= c(i)dt-f dBin(i) . (7) 

Note that bin and bout are different parts of the same 
quantum field, namely before and after interaction with 
the system [S^, [Sj] ■ As such the input and output fields 
will only commute with an arbitrary system operator s 
at different times, 

[dBin(i),s(t')l - V<' <i , (8) 
[dBout(i),s(t')l - V<'>t. (9) 

Here [A, B] i s the mop-bracket for two vops A and B, 
defined as |34j 

[A,B] = AB^ - (BA^)^ . (10) 

An arbitrary vop s will evolve, due to the measurement 
interaction, according to the quantum Langevin equation 
derived from ([6]) 

h[ds]„, = {i[Hi,s]+ J[c^]s~ \ {c^c,s})dt 

+ [ctdBi„-dBt„c,s] , (11) 

where A* = (A^)^ and (see ^) 

J[A}]B = {A}B^Y k . (12) 



It is then easy to show that transforming this to the 
Schrodinger picture gives the master equation due to 
measurement 

h [c?p]ni = Crapdt — —1 [Hi, p]dt + !)[(:] p dt , (13) 

where 

2?[c]p = c^pc*-i{ctc,p} , (14) 
and {A, 13} = AI3 + I3A. 

B. Quantum Measurements 

The output field bout is then measured and the de- 
tector produces a current y. In the Heisenberg picture 
the current is represented by a vector-operator, which in 
general will be some function of the output field bout 

yi = 3 (bout, I) , (15) 

where ^ is measurement noise. 

For the remainder of this paper we concentrate on the 
class of diffusive measurements. It was shown previously 
that the output of such a measurement can be repre- 
sented by an i? X 1 vop [sl, Isl] 

hyi dt = M^dBout + M^dBl^^ -t- hdvir, ■ (16) 

The subscript for the current here does not mean that it 
is related to Hq and Hi in ([T]), instead it is to remind 
us that the current is defined in terms of output field 
dBout- This will be useful when we consider feedback in 
Sec, nil Bj when the current will be defined in terms of the 
input field. Note that corresponding to each component 
of c (or each dissipative channel) we need at most two 
quadrature measurements so R < 2L. The matrix M is 
L X R defined by 

MMV^iG-^I, (17) 

where = {diag(rj) |Vfc, r]k G [0,1]} . The noise dvin 
in (jl6p is a i? X 1 Hermitian vop with zero mean and 
correlations given by 

(hdvin) [hdvinV = ti'Z.dt , (18) 

where 

Z = riI„-M^M. (19) 

We can express d-Vm in terms of independent quantum 
Wiener increments 

h dVin = VZ rfUin + VZ * dU*„ . (20) 

The increments dXJi^ are completely uncorrelated with 
the system so they satisfy 

[dt!i^{t),s{t')] =0 yt,t' . (21) 

We remind the reader that this is not what is usually 
referred to as the measurement noise dvm- 
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C. Adding Feedback 

We can describe feedback on the system by adding 
another Hamiltonian iJfb to ([T]) : 

H = Ho + Hi+ Hn. + Hn, . (22) 

In general -fftb will describe the coupling of the input u, 
which may be a functional of the current yi , to the sys- 
tem. Markovian feedback can be defined as the coupling 
of the measured current yi (in which case u = yi) to 
a Hcrmitian system vop f (see Appendix [X| . As a re- 
sult of working in the idealized limit where yi contains 
white noise it is only sensible to consider f being coupled 
linearly to yi, i.e. 

Hib = hFyi, (23) 

where f and yi are at the same time. Coupling f to any 
nonlinear function of yi would generate time evolution 
which is indescribable by (quantum) stochastic calculus. 

The careful reader will notice a number of issues with 
the Hamiltonian ((23|) . First, yi does not commute with 
f at the same time, so Hf^ as it stands is not even Hcrmi- 
tian. Second, it does not strictly exist because although 
yi dt exists as a stochastic increment, yi does not. 

The first problem can be solved in two ways as was 
recognized in Ref. [l^]- The first is to realize that in 
actuality there must be a finite time delay in the feedback 
loop. Thus, strictly we have 

^fb = ftf^yi(t-T), (24) 

and yi (t—r) commutes with all system operators at times 
later than t—r and so acts as a complex number for r ^ 0. 
The limit r — )■ O"*" can be taken at the end of all calcu- 
lations. We will derive a Markovian (t -^• O"*") master 
equation with feedback using this method in Sec. IHI Al 
The second approach is to treat the feedback as an in- 
stantaneous process at the outset by ensuring that the 
measurement acts before the feedback. We follow this 
approach in Sec. IHI Bl 

The second issue is more serious, and for general (not 
necessarily linear) quantum systems care must be taken 
in determining the evolution generated by Eq. (j24p . 

Our definition of Markovian feedback is directly in 
terms of the feedback Hamiltonian. Placing the definition 
on the Hamiltonian is sensible and appeals to physicists 
since the Hamiltonian is the generator of time evolution. 
In Appcndix|X]we define feedback in a manner that draws 
upon the traditional control systems approach. In this 
language one can differentiate between system dynamics 
that is linear and nonlinear and the results of this pa- 
per can be seen to apply to the more general (nonlinear) 
regime. 



III. UNCONDITIONAL DYNAMICS 

A. Diffusion-mediated Feedback Starting with 
Non-zero Feedback Delay 

1. Feedback master equation 

Since we have already introduced the most general 
form of a master equation in the absence of feedback 
(|13p . we will only derive Cfh in 

hp={Cn, + Cfh)p. (25) 

We will start in the Heisenberg picture in which case the 
quantum Langevin equation corresponding to p is 

ds = [dsU + [ds]fb , (26) 

where [ds]^ is given by Eq. ([TT|) . The feedback contribu- 
tion [dsjfb can be obtained from 

[ds]fb = Ul^it + dt,t) sUfh{t + dt,t) - s . (27) 

The unitary operator here is given by 

U{bit + dt,t)^e-'""='^'^''\ (28) 

It is perhaps not entirely obvious that deriving Cfh (from 
either the Schrodinger or Heisenberg picture) and adding 
it to Cm should result in the correct master equation since 
[c?s]m and [rfsjfb are defined with different time-evolution 
operators. This is justified in Appendix |B] Expanding 
([58)1 to order dt, 

Uibit + dt,t) = i-iFyi{t~T)dt~ iFfdi . (29) 

We have used the Ito rule to obtain the last term in 
Eq. (gni)- Substituting Eq. ^ into (gT]), retaining only 
terms of order dt, and multiplying by h we obtain 

h[ds]fb = ~ihs[{'^yi{t-T)dt] + ih[Fyi{t - T)dt]s 

+ hV[{]sdt. (30) 

The bath is assumed to be in the vacuum state so the 
initial joint system-bath state is 

PsB-p®|0)(0| , (31) 

where p is the system state and |0)(0| the bath state. 
Remember that we are in the Heisenberg picture so pse 
does not evolve. To derive a master equation for p we will 
take the ensemble average of (1501) with respect to and 
this immediately eliminates the vacuum noise contained 
in yi since the vacuum inputs are completely indepen- 
dent of the system. This also suggests that we should 
normally order the terms containing dBout (since then 
dBin will annihilate the vacuum to give zero when aver- 
aged). Considering the first term of ([511)) for the moment, 
we obtain, upon substituting in ([T6|) 

-ih{s[Fyiit-T)dt]) = -z(s[FM^ciBout(i-r)] 

+ s[FM'^dBl,it-T)]). 

(32) 
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The first term here is already in normal order while the 
second term can be written as 

s [FM^dBl.it - r)] = [sdBLt(i - r)] M F 

= [dBLt(i-r)s^]^Mf , (33) 

where we have noted the mop-bracket © in (|33p . Using 
these orderings and ([7]), the average of ([5^ is simply 



-ih{s[Fy{t-T)dt]) = -i{s[i^Mlc{t-T)] 

+ [c*(t-T)s^]^Mf). (34) 

Now taking the Markovian (r — >■ 0) limit and writing the 
average as a trace we get 

= -iTr|sFMl'cpsB + (c*s^)^MfpsB}dt 

= -iTr|sFM^cpsB+s(MfpsBfc*|<it 

= -iTr|sF(M^cpsB+PsBM^c*)}di . (35) 

To obtain the Markovian limit of the average of the 
second term in pop we can perform a similar calculation 
as above, or, alternatively note that 

lim in{[yJ{t-T)dti]s) 

r— )-0+ 

= ( lim -ih(sUFyi(t-T)dt])y 

r{s(psBctMf + c^M*psB)f}dt . (36) 



i Tr-^ 



The last line is obtained by letting s — > sMn ((35)) and 
using the cyclic property of trace to permute s to the left. 
The average of 'D[i]sdt in ([50)1 can simply be expressed 
as 



h {V[f] s) dt = Tr|s hV[{] psB } dt 
Adding ((35]) . (p6)) . and ([37|. we arrive at 
ft( [ds]fb) = Tr|s[;il?[f] psB - i r(MtcpsB + 



Psi 



(37) 



= Tr{s(-i[f,M^cpsB+PsB 
+ hV[i] psB)}dt. 



)f jdi 



(38) 



In the last equality we have made use of the sop-bracket, 
defined by [3J| 



[A,Bj = A^B-B^A 



(39) 



Remember that we are only working out the time evolu- 
tion due to feedback so the feedback contribution to the 
full master equation is defined by 



(40) 



where p{t) here is defined by the partial trace over 
the bath p{t) = TrB{psB(i)}- We thus obtain, in the 
Schrodinger picture, where operators are understood to 
be time-independent and p time-dependent, 

h[dp][b = Cfhpdt 

= (hV[i]p -i\i,M^cp + pM'^ci\)dt . (41) 



Adding this to the measurement master equation defined 
by (fT5|) we obtain the diffusion-mediated Markovian feed- 
back master equation 



hp = CmlbP - 



i[Hi,p] +V[c]p + hV[{]p 
i[f,Mtcp-HpM^c*J. 



(42) 



Note that ([42|l is valid for nonlinear systems (see Ap- 
pendix E| as no assumptions about Hi, c, and f were 
made in our derivation. That Cm + Cfh is again of the 
Lindblad form is a rather lengthy exercise so we have 
proved it in Appendix [Cj The result may be written as 

hp^ + i(FM^c-fc^Mf),p] 



V[c-iMi]p + V[x/hlj,-WM i]p, (43) 



where \/hln — MtM may be replaced by any matrix 
square root of SIr — M^M [6l|. We remark that while 
the Lindblad form is an important part of the theory, 
(|43| is not necessarily more useful than (|42l) . 



2. Feedback quantum Langevin equation 



Equation (|42|) . or (j43|) . describes feedback in the 
Schrodinger picture but they are not the only equations 
of motion capable of capturing the feedback process. 
An alternative theory of feedback exists in the Heisen- 
berg picture where feedback is described by a quantum 
Langevin equation for an arbitrary system vop s. Such 
an equation follows unitary evolution and has the inter- 
pretation that measurements (namely the collapse of p as 
occurs by using a measurement operator) never happens. 
Thus it also describes "feedback without measurement" 

da. 

As before, the calculation can be simplified by first 
deriving the change in s due to feedback only and then 
adding it to the measurement contribution. This can be 
obtained from (j30p by substituting in the expression for 
yi and then normally ordering dBout- The final result, 
including the measurement contribution is 
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hds= {i[Hi,s] + J^[c*]s- i{c'''c,s} + hV[i]s)dt+ [cUBin - dBl^c,s] 

-i[s, M* f ] [c{t - T)dt + dBi„(t - r)] + i{ [c\t - T)dt + (iBj„(t - r)] [M f , s] | 
- 4s, VZ* f ]dUin(t - r) + z{dUtjt _ r) [VZ f , s] }^ . 



The matrix \/Z is the positive square root of ([T9| and 
dUin is an independent Wiener increment (recaU (l20l) and 
([2T|) ). One can check that (j44|) is a vaUd Ito equation, 
i.e. 

d{sa) = (ds) a + s [da) + (ds) (da) , (45) 

for any operator a. Note that we can take the Markovian 
hmit of (|44|) by setting r = in dBin(t — t) since bin(t) 
is continuous in time, although nowhere differentiable. 
The resulting equation with r = in (|44|) is then the 
Heisenbergpicure equivalent of (H^ in the sense that 

d (s) = Tr [psB (0) dm] = Trs [dp{t) s(0)] . (46) 

B. Diffusion- mediated Feedback Starting with Zero 
Feedback Delay 

When we allow the feedback delay to be zero we are let- 
ting the time at which f interacts with the bath converge 
to the same point in time as the interaction between c 
and the bath. This eliminates the concept of bout- Con- 
sequently the feedback interaction should be defined by 

^fb = /iFyo, (47) 

where yo is 

hya dt = M^dBin + M^dBf„ -I- hdv^^ . (48) 

By working in the limit of zero feedback delay we are 
also allowing the measurement and feedback interactions 
to occur in the same infinitesimal time interval [t^t + dt), 

Umfh{t^ t + dt)^ Ufb{t, t + dt) U^{t, t + dt) . (49) 
where 

Uih{t, t + dt) — exp (— iHfhdt/h) — exp ( — i f^yo dt) . 

(50) 



(44) 

I 

Since iffb and do not commute the order of C/fb and 
Ura matters and the correct order is defined by the order 
in which the two processes happen in reality. This order 
should correspond to the order in which the unitaries act 
on a state, as shown in p9)) . That is the Schrodinger 
picture is what defines the order in which we compose 
Uni and C/fb to give Umth- When we evolve a vop s in the 
Heisenberg picture from t to t + dt under measurement 
and feedback the order is then given by (with the unitary 
operators understood to act over an infinitesimal interval 
from t to t + dt) 

s{t + dt) = ?7^f^ s J7n,fb = Ul Ul s Ui^ U„, . (51) 

There is of course nothing odd about letting C/fb act on s 
first in (j5ip . it is simply a consequence of the definition 
of the Heisenberg picture. If one insists on having Um 
act on s first, even in the Heisenberg picture, then we 
can rewrite ((5T|) as 

s{t + dt) = UI^U^^ s t7,„C/fbi , (52) 

where we have defined 

C>fbi = Ul Ui^ Un, = exp ( - i iJfbi dt/h) . (53) 

The Hamiltonian iffbi is given by 

TJfbi dt = h F{t + dt) yi dt , (54) 

and yi is as before, given by p^ . Note that (IMl) has 
no ordering ambiguity (recall the discussion surrouding 
(IMl) ) on its RHS since the current yi appears at an (in- 
finitesimally) earlier time than i{t + dt). In what follows 
we will take the former approach, i.e. with a vop in the 
Heisenberg picture defined by (ICTj) and a feedback Hamil- 
tonian given by and dH]). 

The Hudson-Parthasarathy equation for Umfh{t,to) is 



hdUn,fh{t,tQ) = \{-iHi - c''c/2 - M^f /2 - iF M'fc) dt + dBl^{c ~~ iMf) - (c^^ + i FM^)dBi„ 



Umfhit, to) , 



(55) 
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with the initial condition Uinfhito,tQ) = 1. From this we can derive yet another quantum Langevin equation, 

hds^i[Hi,s] dt + hV[i]sdt- [s,c*](icdt + dBin) - ^{^cUt + dBl^)[c,s]y 

+ i{(ctdt + dBj„)[Mf,s]}^ -4s,M*f](cdt + dBi„) -4s,yZ*f]dUi„+ . (56) 



This is again a vahd Ito equation in the sense of ps)) 
and we have also placed the bath fields on the exterior so 
that terms containing dBjjj or dSj^ vanish when averaged 
against a vacuum bath state. 

Here we have to be careful that ((5^ is not quite the 
same as the equation which results from setting r = in 
pi)) . Their difference lies in the last term (a commutator) 
in the first line of (|44l) and the last two terms in the 
first line of (ISBl) . Let us illustrate the difference by first 
simplifying (H^ and by letting Hi = and f = in 
both equations. In this case (|44p simplifies to, 

hds^ (J^[c*]s- i{c'fc,s})dt + [ctdBin - dB|'„c,s] , 

(57) 

while ([55)) simplifies to 

hds^ - [s,c*] (i cdt + dBin) 

-{{^cUt + dBl)[c,s]y . (58) 

To arrive at (fSS)) we have used the fact that dBin will 
commute with an arbitrary system vop s at the same 
time. This means that in ([551) (and also (|56p ) s is strictly 
a system vop; setting s to a bath vop in ([56| would violate 
this assumption. Setting s — bin in ([55]) (or ([55))') yields 
the nonsensical result bout — bi„. On the other hand 
([33]), and therefore ([57)) . uses only the commutability of 
dBoutit—r) with s{t) for r > 0. This is actually preserved 
even when we let s be a bath field. Indeed, when we set 
s = bin in ([57)) (or ([44| ) the correct output relation of 
the bath field is obtained. 

To derive a master equation we may move into the 
Schrodinger picture from ()55p or simply take the average 
of ([56)) . Since ([56)) is normally ordered in the bath vops, 
its average with respect to ([5T)) is simply 

h{ds) = (^[i^l,s] - i[s,c*]c- i(ct[c,s])^ 

+ hV[f]s + i{c^[M{,s])^ -i[s,M*f])dt . 

(59) 

It is easy to show that 

-i [s, ct] c - i (ct [c, s] Y = (c*s^)^c - i {etc, s} 

= J7[c*]s-i{ctc,s} . (60) 

So the first line of ([5^ is just the average ([TT)) for which 
the contribution to p is well-known, given by ()13p . The 



first term on the second line is given by p7l) while 
(ct[Mf,s])^ -Tr{s(psBctMf-rp,BM^ct)} , 

(61) 

([s,M*f]c) =Tr{s(rMtcp3B-c^MV3Bf)} • (62) 

Therefore the second line of ([5^)) is in fact (1551) . From 
these it should be clear that a master equation exactly 
of the form given by ([42)) results, as expected. If we were 
not interested in the quantum Langevin equation then 
one would, and is in fact quicker, to derive the master 
equation directly from ([55]). 

IV. CONDITIONAL DYNAMICS 

To better understand applications of feedback one 
would like to know the controlled system dynamics as 
the monitoring and feedback occurs in real-time. It is 
well-known that continuously measured systems can be 
described by a nonlinear stochastic differential equation 
for the system state [U, [s^. Here we will derive the 
a general diffusion-mediated stochastic feedback master 
equation in the Heisenberg picture. This is an exten- 
sion of the diffusive stochastic master equation found in 
Refs. [11] to include feedback but using a different 
parameterization of the measurement. We illustrate the 
two cases (with and without feedback) in Fig. [5| 



A. Diffusion-mediated Feedback Stochastic Master 
Equation 

Previously we found the most general diffusive stochas- 
tic master equation with measurments alone to be given 

by, 

dpc = CmPc dt + ■H[dw'^M'^c\pc , (63) 

where Cm is given by ([T5)) and dw is an i? x 1 (vector) 
Wiener increment defined by E[(iw(t)] = and 

dw{t)dvi^{t) ^lj, dt , (64) 
dw{t) d^^ {t')=0 Mt^t' . (65) 

The superoperator Ti. [A\ , for any A, is defined to be 

UiAlp^ Ap + pA^ -Tt[Ap + pA^]p . (66) 
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FIG. 2: For simplicity we have shown only the SISO case 
with L = I. (a) The situation described by the works of 
Refs. [igl. [33|. in which the observer uses his/her knowledge 
of the measurement record y (treated as a number in the 
Schrodinger picture) to infer the state of the system but in 
the absence of feedback, (b) The situation described by the 
stochastic master equation (jSOp : The observer infers the state 
of the system from the measurement record in the presence 
of feedback. The inclusion of feedback (i.e. /) changes the 
interaction between bin and the system. That is, bin now 
"sees" both c and /, which is why we have written them 
as a pair in the figure. The result of this is to produce an 
output field boutt which evolves according to ((55]), which is 
different to &out (hence the extra "t" in the subscript). The 
actual system-bath input-output relation with respect to (|55p 
is worked out in Sec. IIVBI 



To generalize (|63)) to account for feedback we first note 
that our foregoing derivation of the master equation pre- 
scribes us with the rule 



ifb 



(67) 



for the unconditioned evolution. But how does the con- 
ditional dynamics change? That is how can the nonlinear 
term in (|63p be altered to include feedback? 

A derivation of the stochastic master equation in the 
Heisenberg picture would be possible if we can establish 
a relation about the time evolution in the Schrodinger 
and Heisenberg pictures that involves the conditioning. 
For unconditional evolution such a relation is given by 
which made the derivation of the master equation 
possible in the Heisenberg picture. We can in fact find an 
analogous relation that incorporates the conditioning of 
p on the measured current. By considering the evolution 
over an infinitesimal time interval such an equation is 



= E|fiw Trs [s^py, [t + dt)] I , (68) 

where we have multiplied each side by fi^ for convenience. 
This identity can be derived using quantum measurement 
theory. For simplicity we are assuming the state to be 
given at time t (i.e. deterministic). The state on the 
RHS of (l68ll is conditioned on the vector-valued current 



hydt ^ (Mtc+ M^c^) dt + hdw 



(69) 



at only one time, t, where dw is a vector Wiener incre- 
ment. To use (j68p we note from quantum measurement 
theory that any diffusive unravelling will be of the form 



(70) 



dpc ~ C pc dt + H [dw^ a] pc 



for some a and C. We therefore make this ansatz in 
with a to be determined by the LHS, which is in the 
Heisenberg picture. 

Using ([70)1 and the fact that pc{t) = p{t) is known, the 
RHS of ([55)1 simply reduces to 



Ejdw Trs [s'^Pytit + dt)] I 
= riTr|dws^-H[rfw^Q;]p| 

= ;iTr| [s {oi^p + pa'' - (a + a^) p)]^^ dt . (71) 
The LHS of mil is 



hmyi~{yi))hs'^it + dt))dt 
= {{hyidt)hf{t + dt)) - {hyidt){hs^(t + dt)) 



(72) 

On substituting in (fT6|) . the first term in (|72l) is 

{{hyidt) hs\t + dt)) ^ (MUBj^^hs'^it + dt)) 

+ (M'^ dBl^^ hs'^it + dt)) 

+ {{hdvin) hf{t + dt)) . 

(73) 

By examining ([56]) it is not difficult to see that 
{MUBj^,hs'^{t + dt)) 

= h{[s{M''c)'^]'^)dt + ih{[M'Mf,s])dt , (74) 
(M^rfB'i^t hs'^it + dt)) = h (M^c*s^) dt , (75) 
{{hdvin) hs^{t + dt)) 

= ih^ {[f, s])dt-ih {[M^fM Is]) dt , (76) 
{hyidt){hs^{t + dt)) 

= ft(M^c) (s^)di + fi(M^c*)(s^)dt . (77) 
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Writing ([74 )) - ([77)) as a trace we get 

= hTr^[s{{M''c - ihi)^ p + p{M^c - ihiy 

-((Mtc)T + (Mtc)t)p}]^}di . (78) 
Equating ([75]) to ([7T|) and solving for a gives 

a = M'fc - ih{ . (79) 

Invoking (|67l) and ([79]) . we arrive at the diffusion- 
mediated stochastic feedback master equation 

hdpc = -i[Hi,pc] +'D[c]pc + fi'D[{]pc 

-^[f,Mtcpe + PcM^c^J 

+ H[dw'^{M^c-iM)]pc . (80) 

Comparing (j80|) to (|63|) we can summarize the changes 
necessary to include feedback in the stochastic master 
equation (j63p by the two transformations 

(81) 

M^c — > M^c- ifif . (82) 

We can understand why f must appear in the nonlinear 
term by considering the case when M = 0. In this case 
the feedback master equation is simply 

hp= -t[Hi,p]+V[c]p + hV[i]p , (83) 

and the current fed back is pure noise 

ydt = dw . (84) 

Equation (j83p is the unconditional evolution for the mea- 
surement defined by ((84)) . If we now condition the state 
on the pure-noise output then the stochastic master equa- 
tion which unravels (|55| is 

hdpc^ -i [Hi,pc] + 2?[c]pc + fi-2?[f]pc 

+ hn[-idw'^f]p^ (85) 

This can be seen by noting that (|84l) can also be written 
as 

y dt ^ {-ii + {-if)i) + dw , (86) 

which gives rise to the nonlinear term in (j85p . When 
M 7^ we get the general case of ([50)) . 

B. Output Correlation Function 

When we include feedback in our theory the controlled 
dynamics can be accounted for by transforming the in- 
put fields according to J7mfb as opposed to [/„!■ That is, 
instead of ([7]) we now have the new output field 

dBoutt(0 = t>ifb(i + dt, t) dBin(t) Umfh{t + dt, t) 

= [c(t) -iMf(i)] dt-FdBin , (87) 



which can be derived from (|55)) . The use of the subscript 
"outt" is deliberate, to be read as "out twice". This is 
to remind us that dBoutt is the output field obtained 
from using C/mfb, which is a composition of two unitaries 
(g^ . The input field dBjn would still have the same mop- 
bracket with an arbitrary system vop s as given by (|8)). 
but dBout in & should be replaced by dBoutt- Thus we 
now have 

[dBi„(t),s(t')] =0 yt'<t, (88) 
[dBoutt(t),s(01 =0 yf >t. (89) 

We should not forget to change the input field dJJin as 
well since it will now evolve under the dynamics of feed- 
back. Recall that dUin was introduced in (|^ . where it 
appeared as a vacuum noise in the current that did not 
interact with the system. When we add feedback this 
noise is redirected onto the system so it is no longer cor- 
rect to assume that it is independent of the system as 
was the case in (l20l) . We thus have an additional input- 
output relation, which can also be derived from (|55p. 

dUoutt(i) = Ula,it + dt, t) dUi„(t) [/,^fb(t + dt, t) 

^dtSin{t)~iVZi{t)dt . (90) 
Similarly to (|55)) and (|M)) . 

[dtin{t),s{t')] -0 yt'<t, (91) 

[di]outt{t),s{t')] =0 yt'>t. (92) 

Relations (|57)) and (jTO)) in turn define a new vop- valued 
current 

= M'f dBoutt + M^dB*„tt + Hdvoutt , (93) 

where the subscript on the current should remind us that 
it is defined in terms of dBoutt, or the number of times 
the letter "t" appears on the RHS. 

h duoutt = VZ dUoutt + VZ * dtJ^utt 

^ hdvin-iZidt + iZ*{dt . (94) 

From dSTj), 0131), and dM]), we can see that 

y2 = yi • (95) 

That is the current evolved over an infinitesimal interval 
from t to t + dt under both measurement and feedback is 
in fact the same as the current evolved in the same time 
interval but with measurement alone. Equation (|95|) can 
also be seen from the form of the Hamiltonian (|47p , which 
gives 

[7?fb,yo]=0. (96) 

Substituting Umfh into the definition of y2 we obtain 

Mt) = Ulf^,{t + dt, t) yo(<) UraUt + dt, t) 

= Ul{t + dt,t)yo{t)Un,{t + dt,t) ^ yi{t) . (97) 
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Using ([93)1 we can calculate how the current at time t is feedback is applied. The time separation r is assumed to 
correlated to the current at a later time t+r during which be non-negative. We then obtain 



fi'iMt) yj{t + r)) = (Mt bo.tt (i) hj^ttit + r) M*) + (Mt b^utt W bLtt(i + r) M) + (Mt b^^tt W ?iCutt(^ + r)) 

+ (M^bLtt W bo\tt(i + r) U*) + (M^ bLt W bLtt(i + r) M) + (M^ bLt W ^C^uttl^ + r)) 
+ {hUtt{t) hl^,,{t + r) M*) + (^Coutt(i) bLt(i + r) M) + (r^CouttW ftCutt(^ + ^)) ■ (98) 

I 



Note that here we have introduced quantum stochastic and also 
processes Coutt and /ioutt, defined in terms of the incre- 
ments by 



dv, 
where 



outt — S»outt 



dt 



dVa 



Z /ioutt + Vz*p,l,,)dt, (99) 



(100) 



Aoutt dt = (/iin ~iVZi)dt . 



Lboutt(0,boutt(t')l = LbLtt(i),bLt(i')l =0 y t,t' . 

(102) 

The same is true for /ioutt since it is also a free field, but 
remember that /ioutt is i? x 1 so 



[/ioutt(i),ALt(^')l =^til^S{t~t') 



As with earlier calculations, the assumption of a vacuum 

bath state suggests that we should substitute m into ^jg^ have, and it is not difiicuh to see, that 



(103) 



and then normal and time order each term before 
the average is taken. The output field vops satisfy the 
familiar free-field mop-brackets 

[boutt(i),bLtt(^')l =^I.'5(i-^') V<,t', (101) 



Lboutt(i), /ioutt (i')l - Lboutt(i),Moutt(i')l =0 Vt,i' . 

(104) 



We summarize the result of each term in Appendix [D] Using the results therein we arrive at 

ft'(y2(0 yJit + r)) - ([Mtc(t + t) + M'^cHt + r)][c^(i) M* - iftF(t)])^ 

+ ([M^c*(t) +iM{t)][c'^it + t) M* + c\t + t)M]) + h'l^ Sir) . 

Applying vop quantum regression formulas to (|105p the final result is 

/ \ T 



(105) 



(y2(0yJ(i + ^)) = Tr|(M^c+ M^c*)e^"''' {c'^ M* - ihF)p{t) + p{t) {c^M + ihF) } + h^lj,5{T) , (106) 



where the time-dependence has been placed in the system 
state and the vops are time-independent. Note that (|106p 
could have obtained by using the transformations ((8T|) 
and (j82p in the measurement-only correlation function 



= (Tr|(Mtc + M^c*)e^"'^[c^ 



as one might have guessed. 



>(<)+p(i)ctM]})^ 
(107) 



SIMPLE CASES 



Here we illustrate how the above theory can be used by 
considering Markovian feedback mediated by homodyne 
and heterodyne detection. For simplicity we take L ~ 
1. In the case of homodyne- mediated feedback we then 
obtain a SISO theory whereas for heterodyne-mediated 
feedback we get a one-input two-output theory. In the 
case of homodyne-mediated feedback we recover results 
previously derived in Refs. [131 and [s^. We will allow 
for non-unit detection efficiency in both cases and write 
r] in place of H. 
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A. Consistency with Previous Results — 
Homodyne-mediated feedback 

Consider the SISO limit defined by a quadrature mea- 
surement of the form 



n (yi) dt (X (dBout + dBl^^t) 



(108) 



defined 77 = 1 — 77 for convenience. We find 

hyidt — y/hrj (c + c'^dt + hdvm , 
where the measurement noise is 

hdv^ = 2 y/K^ 3fi[di?i„] + 2y/h^ ^[dUin] 



The condition that M , now a scalar, must satisfy is simply It is clear that 



hr] 



(110) 



(111) 



(109) {hdvmY = 4.hr] {di[dBin]y + 4hf] (3?[d;7i„])^ = H'^dt 



(112) 

The measurement defined by (|108p can be achieved by 

choosing M = ^/Wrj . This gives Z = hfj, where we have From ([80]) the stochastic feedback master equation is then 



fidpc = (^-~ i[Hi,pc] + V[c\pc + hV[f]pc - iy/hrj [/, cpc + PcC^^ dt + dwHlx/hrjc - ihf]p 



(113) 



This is consistent with the stochastic master equation found in Ref. [5^] for ?i = 1 and when the current is suitably 
rescaled. It also reproduces the master equation in Ref. when h = rj = 1. The Lindblad form of the unconditioned 
evolution can be found directly from (j43|) . 



hp = Cuom P = -i [Hi + \y/twi{fc + ct/), p] + 2?[c - i^/hv I]p + ^vW]p 



(114) 



Again, this is consistent with the Lindblad form obtained in Ref. [HI] (for h—1) and Ref. [27] (for fi, = 77 = 1), but in 
these works the Lindblad form was obtained by algebraic manipulation of (|113p . The two-time correlation function 
of (fnOl) is, from p^ . 



h^{y2{t)y2{t + T)) = V^Tr{(c-f c^)e^'— "[(yft^c-ift/)p + Hc]} +?i2^(r) 



(115) 



and reproduces (4.10) of Ref. [l^] when h = r] = 1. 

We can also find a Markovian quantum Langevin equa- 
tion from either (|44)) or (|56|) . There is no restriction on 
the number of components that s is allowed. For sim- 
plicity we take it to be a scalar-operator. Taking the 
Markovian limit of pij) the homodyne feedback quan- 
tum Langevin equation is 

hds = {i[Hi,s] + J[c'']s-l{c''c,s} +hV[f]s)dt 
+ [cUBin-dBlc,s] 

-iV^[s,/] {cdt + dBin) 

+ iy/fn]{cUt + dBl)[f,s] 
-i^[sJ]dUi,-, + i^dUl[f,s] . (116) 

As before, when h = rj = 1 this correctly reproduces 
(4.16) of Ref. [23] . Note the extra noise terms c??7in and 
dil}^ in pTe]) which do not appear in (4.16) of Ref. [13, 
since there, the quantum Langevin equation was derived 



in the limit of 77 = 1. 

B. Heterodyne- mediated feedback 

A heterodyne detection is equivalent to two homodyne 
measurements of orthogonal quadratures each with half 
the detection efficiency so this requires R ~ 2. Consider 
the heterodyne current defined by 

^ ^ V 2 \-^{dB,^,-dBl,)J 

This can be effected by 




(118) 



which satisfies (|17p . The stochastic master equation from 
(|80| is thus 
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hdp,^ (-i[Hi,p,] +v[c]p, + hv[fi]Pc + fiV[f2]pc 



[/l,Cpc +PcC^] -^\l'-7^ [/2,-j(cpc - PcC^)\^dt 



+ dwi 'H[\/hrj/2 c - ihfi]pc + dw2'H[-i\/hrj/2 c - ihf2]pc 

I 



(119) 



Setting h ^ rj = \ this is consistent with a special case of the unconditioned evolution unravelled by (jll9p has a 
the heterodyne feedback master equation Ref. [STj (see Lindblad form which can be written compactly as 
(5.19)-(5.24) with TV = M = 0). The Lindblad form of 
the master equation unravelled by (I119P can be obtained 
by noting that (|118p leads to 



Z = h 



l-r;/2 -11)12 
i-q/2 1-77/2 



which has the positive square root 

2 [tii-Vv) i + Vv J 

By introducing 



(120) hp=Ci,,tP^ - liHup] 



(121) 



[F^c + c^F, p] 



^V[F^ + V^F]p+^^V[F^-V^F]p 



+ V[c-z^l'fF]p. 



(123) 



F = h+ lf2 



(122) -yyg ^Yie heterodyne current has correlations given by 



^'(y2(0y2^(^ + ^)) 



Tr|(c + ct)e^'""^ 
Tr|(c + ct)e^i-'^ 



^c-ihfAp + m 



-iJ^C-ihf2]p + llc 



} Tr{ -i(c-ct)e^i-'^ (^^M a - ift/i) p + He } 
I Tr| -i(c-ct)e^''-'^ ( - iy^c - i/i/z^p + He | 



+ h Sir) 



(124) 



As with the homodyne case we can derive a heterodyne quantum Langevin equation assuming s to be a scalar-operator 
by taking the Markovian limit from (l44l) . The result is 



hds= {i[Hi,s] + J[c^s- ^{c^c,s} + hV[f]s)dt 

+ [cUBin - dBlc, s] - i -y/^ [s, F"^] {cdt + dI3u 



(at dt + dBl)[F,§] 



i[s,F + y^TF^] dUini -t[s,-i{F + ^F^)] dUin2 + iduU [VnP + F\s]+ idul^ [ - i{^) F - F^),s] . 

(125) 



VI. DISCUSSION 



We have constructed a theory of Markovian quantum 
feedback control for nonlinear systems with an arbitrary 
number of decay channels, inputs, outputs, and mediated 
by arbitrary diffusive measurements. We have derived 
the time evolution of the system state both with and 
without conditioning, for a vacuum bath input. When 
the evolution is unconditioned one may find an equivalent 



formulation in terms of quantum Langevin equations and 
we have derived these equations too. We also derived the 
two-time correlation function for the measured current 
including feedback. 

We have performed our derivations using the Heisen- 
berg picture, where the entire feedback loop is described 
by unitary evolution. Most notably we established rela- 
tion (p5)) , which can be viewed as the analogue of pS)) but 
for conditional evolution. This is what allowed us to de- 
rive the stochastic master equation from the Heisenberg- 
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picture quantum Langevin equations. 

It is interesting to note that the two-time correlation 
function of the measured current is an expression about 
measurements at two separated times. It therefore lends 
itself as a different way of deriving the stochastic master 
equation. In this approach one would calculate the corre- 
lation function in the Schrodinger picture by making the 
ansatz (|70| and equating the end result to (|106|) . Solving 
for a should result in ([75]) . If one was only interested in 
the stochastic master equation then this second method 
is however much less direct than the first approach, as the 
calculation of the correlation function in the Heisenberg 
picture is a very lengthy process. Alternatively, one could 
derive a stochastic master equation first and then use it 
to derive the autocorrelation of the current on which the 
state is conditioned in the Schrodinger picture. However, 
our approach to obtaining the autocorrelation of the cur- 
rent and the stochastic master equation, has not been to 
derive one result from the other, but rather each result 
independently. 

The interpretation of the Heisenberg picture approach 
was recognized in Ref. [l^] and also discussed in detail 
in Ref. [5] . In essence this is a no-measurement (or more 
precisely no-collapse) model where the observer is never 
aware of the measurement record from the monitoring. 
Consequently we have refrained from using terms such 
as "unravellings" or "conditional" unless in explicit ref- 
erence to results in the Schrodinger picture. 

Finally we note that it would be possible to generalize 
the results of this paper even further by allowing the bath 
to be non-vacuum. In such a theory we would have to 
allow dBin to have a non-zero mean and correlated more 
generally as opposed just 
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Appendix A: CONNECTION TO CONTROL 
SYSTEMS ENGINEERING 

The standard engineering approach to feedback con- 
trol is to start with a stochastic differential equation of 
a vector x. A model of the system in the time domain is 
known as a state-space model and the vector x a state. 
The state contains variables such that if these variables 
are known at time t then all other system variables at 
time t may be calculated from it [ssj . 

The state-space model can be translated to quantum 
dynamics most easily via the Heisenberg picture. In the 
Heisenberg picture we define a Hermitian vop x, from 
which an arbitrary system operator s can be defined. We 
will be considering continuous Markov processes in which 



case, 

dx = a{x, u, t) dt + /3(x, t) dvp , (Al) 

where u is the input (potentially arising from feedback), 
and dVp is a quantum Wiener increment defined by 

(dvp(O) = , (A2) 

and the Ito rules 

dvp(0 dvj(i') =0 yt^t' , (A3) 

dvp(i)dvj(t) =Idi . (A4) 

Note that a is a vop-valued function while /3 maps to a 
matrix (which in general may mop- valued). 

We will assume the system to be monitored via R chan- 
nels and that the measurement noise to be diffusive. Let 
us denote the measurement results by yi , which can be 
written in the general form 

yi dt — g{x, u, t) dt + rivm . (A5) 

The noise term is another Wiener increment and is 
what defines the measurement to be diffusive. It is often 
assumed that dVp is uncorrelated with dvm. One could 
of course drop this assumption and allow the two noises 
to be correlated if necessary fs']. It is conventional (and 
we will follow this convention) to call yi the output. 

Equation (|A1[) is generated by a Hamiltonian which 
one often writes in the general form 

H^Hi+ An + Hfb . (A6) 

Here i7,n is still defined by ([2]) but the feedback Hamil- 
tonian is kept general, of the form, 

Hih = Fu , (A7) 

where u and f are Hermitian and [f , uj = to ensure the 
Hermiticity of _fffb. The input is then used to influence 
some system observable f . Note that when u is a feedback 
input it will be a functional of the output yi, which is a 
bath vop so the condition [f , uJ = will be guaranteed. 
When the input is chosen to be linear in the output 

u(<)=Lyi(i-r) , (A8) 

where r is the feedback delay, the feedback is said to be 
proportional, or, Markovian (provided r — ?> 0+). Note 
that to obtain Markovian system evolution the matrix L 
needs to be independent of time. We will absorb L into 
the definition of f and just define Markovian feedback by 

u(i) =yi(t-r) , (A9) 

and f a i? X 1 vector-operator. This will keep our calcula- 
tion simpler, without the need to write out L explicitly. 
Taking the input and output to be of the same dimension 
is no less general than if they were of different dimensions 
as we can always pad zeros in u (or yi, since u is just 
the time-delayed version of yi ) if there is no feedback in 
some of the input channels. It is also not sensible to allow 
u (and therefore yi) to have more than R components 
since then the inner-product f^u is undefined. 
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Appendix B: Derivation of Eq. (|26[) 

It would be most natural to derive the inifinitesinial 
evolution given by (j26p with the full unitary operator 

UnMt + dt, t) = cxp[-i {Hi + + iJfb) dt/ h] , 

(Bl) 

where and Hfb are given by ([2]) and ([24| respectively. 
Expanding this to order dt, 



Umlhit + dt,t) = i 



- ^{Hmdt + Hi^dtY . (B2) 

The important step here is to note that cross terms be- 
tween and Hfb do not contribute for a nonzero feed- 
back delay r: 

{H^ dt) (iJfb = {dBl c - ctdBi„) [hFyiit - r) dt] 

(B3) 

^nc'^[dBlyJ{t-T)dt]i 

-hc''[dBinyJit-T)dt]{ . (B4) 

Recall that yi{t — T)dt is defined in terms of dBout — t) 
and (iBQ^j(i — r), which for r > 0, 

[dBout(i - T),dBi„(0] = [dBout(t - T),dB^„(0] = , 

(B5) 

and similarly with dBout replaced by dB^^j. Therefore 
the products dBf^ yj it — r) dt and dBin y7 ~ ''') can 
always be written as normally ordered functions in the 
input fields which average to zero for a vacuum bath. 
Similarly, [Hfa dt) {H^ dt) is also negligible. Letting h = 
1 for simplicity, we thus obtain 



U. 



^^{t + dt,t)sUnMt + dt,t) 



= s — is 



Hib)dt 



-is {H^ dt + Hfh dtf + i{Hi+ H,^ + H[h)dt s 
+ {Hn, dt + Hfb dt) s {H^ dt + Hfh dt) 



\ {H^dt + Hfbdtf s 



(B6) 



Expanding and collecting terms proportional to Hi + H^i 
as one group and terms proportional to Hfh as another 
group we get 

ul[k{t + dt,t)sU,Mt + dt,t) 



^i{Hi+H„-,)dt ^^-i{Hi+H^)dt 



(B7) 



We have noted that adding Hi to iJm on the exponent of 
the exponential only has an effect to order dt. Subtract- 
ing s from each side this is simply 



It should be apparent from the above that the validity 
of (|B8p relies on the procedure of first allowing t 7^ 
and then letting r 0+ in the end. 



Appendix C: DERIVATION OF Eq. (gl 



We wish to derive (|43|) from (|42|) . For convenience we 
restate (|42|) here 

Cp= -i [Hi ,p]+V[c]p + hV[f]p 

-i\i,M^cp + pM'^c^l . (CI) 

Consider first the two terms I?[c]p and [f , M^cp -t- 
pM^c-'-J. Expanding the sop-bracket, 

= c^pc* — i pc^c — ic'^cp 

+ ic^pM*f -iFM^pc* + ipc^Mf - iFMl'cp . 

(C2) 

We can regroup terms as follows 
2?[c]p-4f, M^cp + pM^c^J 
= ic^p^c* +iM*f) + -iFM^^pc* 
- ipct(c-iMf) - i(ct + iFMt)cp 

+ ic^pM*f- §FM^pc* + §pctMf- §FMtcp . 

(C3) 

Guided by the terms with parentheses in (jC3|) we add 
and subtract I?[Mf]p to the last line in (jC3l) . Using the 
identity 

ipc^^Mf- fFMtcp^ |ctMfp- ipFMtfi 

- I [rMtc + ctMf,p] , 



the last line of (IC3I) can be written as 



(C4) 



|c^pM*f - §FM^pc* + ipc^Mf- fFM^cp 
= - f [FMtc-hctMf,p] +X'[Mf]p-X'[Mf]p 

+ f cTpM*f- f Fm^pc* + |ctMfp- ipFM+c 

= - |[FMl'c-hctMf,p] -^[Mflp 

+ §(^c^ -iFM^)pM*f- iFM^p(^c* +iM*f) 

+ §(c^ -HiFM^'^Mfp- |pFM^(c-iMf^ . (C5) 



ds = [dsjm + [ds]fb . 



(B8) 



Substituting this back into (|C3p and collecting like terms 
we get 

2?[c]p-4f, Mtcp + pM^c*J 
= - |[FM^c + ctMf,p] +X'[c-iMf]p 

-I?[Mf]p. (C6) 
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Substituting this back into Cp we arrive at 

Cp^ + i(FMtc + ctMf),p] 

+ V[c- iM{]p + hV[f]p-V[M{]p . (C7) 

The final two terms can be written as 

hV[i]p-V[M{]p = h{^ pf-^{^M^pM*{ 

- f pFf + ipFM^Mf 

FpZ*f- iFzfp- ipFzf . 

(C8) 

Recall that Z = hl„ — M^^M , which was defined under 
(UHl). Since Z > , there exists a B such that Z = B^B. 
Therefore we are free to write 

hV[l]p-V[Mf]p 

= FB^pB*f- iF(B^B) fp- ipF(B^B) f 

= P[Bf]p. (C9) 

I 



The final master equation in Lindblad form is therefore 
(leaving B as a general matrix square root) 



hp= + i(FMl'c + c1'Mf),p] 

+ V[c-iMi]p + V[Bi]p . (CIO) 



Appendix D: DERIVATION OF Eq. (flOSll 

For clarity we will label each term in 



ft'(y2(t) yj{t + r)) = (Mtboutt(i) hj^ttit + r) M*) + (Mtboutt(i) bLt(i + r) M) + (Mtboutt(i) hCj^,,{t + r)) 

term A term B term E 

+ (M^bLttW hl^ttit + r) M*) + (M^bLttW bLt(i + r) M) + (M^bLtW Hjuttit + r)) 

term C term D term F 

+ (?iCoutt(i) hj^ttit + r) M*) + {hUtt{t) bLt(^ + r) M) + {hUtt{t) hCj^t + r)) . (Dl) 

term G term H term I 

For convenience we use "cw" to abbreviate "cancels with" . Normal and time ordering of each term leads to 
Term A: 

(Mt boutt(i) bj,,t(t + r) M*) = ( M^c{t + r) c^(t) M*)^ - (^ M^c{t + r) F(t)(Mt M)*)^ 

Al A2 (ew G2) 

- (iMtMf(t + T)c^(t)M*)^ - (M^Mf(i + T)F(t)(M^M)*)^ . (D2) 

A3 (ew El) A4 (cw G4) 

Term B: 

(Mtboutt(i) hl^ttit + r) M) ^ (M'^c^t + r) F(t) M*)^ - (iM'^c^t + r) F(t) (M^M)*)^ + M + M 5(t) 

Bl B2 (ew H2) B5 (cw II) 

+ (i(Ml"M)*f(t + r)c^(t) M*)^ + ((M1"M)* f (t + t) f (i) (M1"M)*)^ . (D3) 

B3 (ew E3) B4 (ew E4) 

Term C: 

(M^ bLt W bo\tt(i + r) M*) = (M^c* (t) c^(t + r) M*) - ( z M^cHt) F(t + r) (MtM)*) 

Cl C2 (cw Fl) 

+ (i(M'fM)*f(i)cT(t + r)M*) + ((MtM)*f(t)F(t + T)(M'^M)*) . (D4) 

C3 (ew G6) C4 (cw F2) 

Term D: 

(M^bLtW bLtt(i + r) M) = (M^cHt) ct(i + r) M) + {tM'^cHt) F(t + r) MtM) 

Dl D2 (cw F3) 

+ (i(M^M)*f(t)c'^(t + T)M) -((M^M)*f(t)F(t + T)M^M) . (D5) 

D3 (ew H6) D4 (cw F4) 
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Term E: 



(Mtboutt W hCjutdt + r)) - MtM f(t + r) cT(t) M*)"" + (MtM f(i + r) F(t) (MtM)*)'' 

El (cw A3) E2 (cw 13) 

- (i (MtM)* f(^ + t) c^(t) M*)^ - ((M^M)* {{t + t) (M^M)*)^ . (D6) 

E3 (cw B3) E4 (cw B4) 



Term F: 



Term G: 



Term H: 



Term I: 



(M^bLtW Hl^uit + r)) = (tM-^cHt) F(t + r) (MtM)*) - ((MtM)* f(<) F(t + r) (MtM)*) 

Fl (cw C2) F2 (cw C4) 

- M^ct(t) F(i + r) MtM) + ((MtM)* f(i) F(< + r) MtM) . (D7) 

F3 (cw D2) F4 (cw D4) 



(ftCoutt(i) bltt(i + r) M*) = (-zft Mtc(i + r) ^{1}^ + {iM^c{t + r) ^{1} (MtM)*)^ 

Gl G2 (cw A2) 

- (^iMtM f(t + t) F(t))^ + (MtM f(t + t) F(i) (MtM)*)^ 

G3 (cw 12) G4 (cw A4) 

+ {ih{{t)c^{t + T) M*) - (i (MtM)*f(i) c^(t + t) M*) 

G5 G6 (cw C3) 

+ {hf{t) F(i + r) (MtM)*) - ((MtM)* f(t) F(i + r)(MtM)*) . (D8) 

G7 (cw 16) G8 (cw 17) 



(/iCoutt(i) bLtt(i + r) M) - (-i;iM^ct(t + r) ^(t))^ + (i M^ct(i + r) F(i + r) (MtM)*)^ 

HI H2 (cw B2) 

+ (ft (MtM)* f(t + t) r(t))^ - ((MtM)* f(f + r) F(i) (MtM)*)^ 

H3 (cw 14) H4 (cw 15) 

+ {ihfit) ct(t + T)M) - (i(MtM)*f(i)ct(t + r) M) 

H5 H6 (cw D3) 

- (ftf(t) F(t + t) MtM) + ((MtM)* f(<) F(i + r) MtM) . (D9) 

H7 (cw 18) H8 (cw 19) 



{hCouu{t)fiCjuttit + T))=H^l^S{T)-hM^M S{t) 

II (cw B5) 

+ (?iMtM f(t + t) F(t))^ - (MtM f(t + r) F(t) (MtM)*)^ 

12 (cw G3) 13 (cw E2) 

- (?i(MtM)* f (i + t) r(i))^ + ((MtM)*f(t + t) r(t) (MtM)*)^ 

14 (cw H3) 15 (cw H4) 

- (ftf(<) F(i + r) (MtM)*) + ((MtM)* f (t) F(t + t) (MtM)*) 

16 (cw G7) 17 (cw G8) 

+ (ftf (<) F(i + t) MtM) + ((MtM)* f{t) f^{t + t) MtM) . (DIO) 

18 (cw H7) 19 (cw H8) 



The remaining terms are Al, Bl, CI, Dl, Gl, G5, HI, lecting like terms we arrive at (jlOSp . 
H5, and the /i^Ihi5(t) in term I. Adding these and col- 



[1] J. Bechhoefer, Rev. Mod. Phys. 77, 783 (2005). 



[2] D. S. Bernstein, IEEE Control Syst. Mag. 22, 53 (2002). 



17 



[3] G. F. Franklin, J. D. Powell, and A. Emami-Naeini, 
Feedback Control of Dynamic Systems, (Pearson Prentice 
Hall, 2006). 

[4] S. Habib, K. Jacobs, and H. Mabuchi, Los Alamos Sci- 
ence No.27, 126 (2002). 

[5] H. M. Wiseman and G. J. Milburn, Quantum Measure- 
ment and Control, (Cambridge University Press, 2010). 

[6] R. C. Dorf and R. H. Bishop, Modern Control Systems, 
(Pearson Prentice Hall, 2008). 

[7] K. Zhou, J. C. Doyle, and K. Glover, Robust and Optimal 
Control, (Prentice-Hall 1996). 

[8] A. Doherty, J. Doyle, H. Mabuchi, K. Jacobs, and S. 
Habib, Proceedings of the 39th IEEE Conf Decision and 
Control, 949 (2000). 

[9] A. C. Doherty and K. Jacobs, Phys. Rev. A 60, 2700 
(1999). 

[10] A. C. Doherty, S. Habib, K. Jacobs, H. Mabuchi, and S. 

M. Tan, Phys. Rev. A 62, 012105 (2000). 
[11] J. Gough and M. R. James, IEEE Trans. Auto. Control 

54, 2530 (2009). 
[12] M. R. James, H. I. Nurdin, and I. R. Petersen, IEEE 

Trans. Auto. Control 53, 1787 (2008). 
[13] R. Somaraju and I. R. Petersen, Proceedings of the 2009 

American Control Conference 719. 
[14] A. I. Maalouf and I. R. Petersen, Proceedings of the 2009 

American Control Conference 1472. 
[15] D. Dong and I. R. Petersen, New J. Phys. 11, 105033 

(2009). 

[16] H. Mabuchi, New J. Phys. 11, 105044 (2009). 

[17] M. Yanagisawa and H. Kimura, IEEE Trans. Auto. Con- 
trol 48, 2107 (2003); M. Yanagisawa and H. Kimura, 
IEEE Trans. Auto. Control 48, 2121 (2003). 

[18] K. Jacobs and A. Shabani, Contemp. Phys. 49, 435 
(2008). 

[19] H. M. Wiseman and A. C. Doherty, Phys. Rev. Lett. 94, 
070405 (2005). We note that two new representations of 
diffusive quantum measurements have been found by the 
present authors 34]. 

[20] C. Ahn, H. M. Wiseman, and G. J. Milburn, Phys. Rev. 
A 67, 052310 (2003). 

[21] L. K. Thomsen, S. Macini, and H. M. Wiseman, Phys 
Rev. A 65, 061801(R) (2002). 

[22] P. Goetsch, P. Tombesi, and D. Vitali, Phys. Rev. A 54, 
4519 (1996). 

[23] D. B. Horoshko and S. Ya. Kilin, Phys. Rev. Lett. 54, 
840 (1997). 

[24] A. R. R. Carvalho and J. J. Hope, Phys. Rev. A 76, 

010301(R) (2007). 
[25] J. Wang, H. M. Wiseman, and G. J. Milburn, Phys. Rev. 

A 71, 042309 (2005). 
[26] H. M. Wiseman and G. J. Milburn, Phys. Rev. Lett. TO, 

548 (1993). 

[27] H. M. Wiseman, Phys. Rev. A 49, 2133 (1994). 

[28] J. Zhang, R.-B. Wu, C.-W. Li, and T.-J. Tarn, IEEE 

Trans. Auto. Control 55, 619 (2010). 
[29] J. Combes, H. M. Wiseman, and K. Jacobs, Phys. Rev. 

Lett. 100, 160503 (2008). 
[30] S. Mancini and J. Wang, Eur. Phys. J. D 32, 257 (2005). 
[31] S. Mancini, Phys. Rev. A 73, 010304(R) (2006). 
[32] S. Mancini and H. M. Wiseman, Phys. Rev. A 75, 012330 

(2007). 

[33] H. M. Wiseman and L. Diosi, Chem. Phys. 268, 91 
(2001). 

[34] A. Chia and H. M. Wiseman, arXiv: quant-ph/1102.3073 



(2011). 

[35] T. J. Tarn, G. Huang, and J. W. Clark, Math. Modeling 

I, 109 (1980). 

[36] G. Huang, T. J. Tarn, and J. W. Clark, J. Math. Phys. 

24, 2608 (1983). 
[37] C. K. Ong, G. Huang, T. J. Tarn, and J. W. Clark, Math. 

Syst. Theory 17, 335 (1984). 
[38] M. J. Maciejowski, Multivariable Feedback Design 

(Addison- Wesley, 1989). 
[39] O. N. Gasparyan, Linear and Nonlinear Multtvanable 

Feedback Control: A Classical Approach, (John Wiley & 

Sons, 2008). 

[40] S. Skogestad and I. Postlethwaite, Multivariable Feed- 
back Control: Analysts and Design, (John Wiley & Sons, 
2005). 

[41] J. Q. Ying, Siam J. Control Optim. 38, 313 (1999). 
[42] D. E. Rivera and S. V. Gaikwad, J. Proc. Cont. 5, 213 
(1995). 

[43] T. J. Harris, C. T. Seppala, and L. D. Desborough, J. 

Proc. Cont. 9, 1 (1999). 
[44] S. Tong and H.-X. Li, IEEE Trans. Fuzzy Syst. 11, 354 

(2003). H.-X. Li and S. Tong, IEEE Trans. Fuzzy Syst. 

II, 24 (2003). 

[45] S. Lee and M. Park, lEE Proc. Control Theory Appl. 
150, 421 (2003). 

[46] Q. Zhang, IEEE Trans. Auto. Control 47, 
525 (2002). See also: Internal publication 
4111 of Institut National de Recherche en In- 
formatique et en Automatique (available at 
'ftp: //ftp. inria.fr/INRIA /publication/ RR /RR-4 lll.pdf). 

[47] M. Farza, M. M' Saad, and L. Rossignol, Automatica 40, 
135 (2004). 

[48] H. J. Carmichael, Statistical Methods in Quantum Op- 
tics 1, Corrected Second Printing 2002, (Springer- Verlag, 
1999). 

[49] V. B. Braginsky and F. Ya. Khalili, Quantum Measure- 
ment, (Cambridge University Press, 1992). 

[50] K. R. Parthasarathy, An Introduction to Quantum 
Stochastic Calculus, (Birkhauser, 1992). 

[51] R. L. Hudson and K. R. Parthasarathy, Commun. Math. 
Phys. 93, 301 (1984). 

[52] C. W. Gardiner and M. J. CoUett, Phys. Rev. A 31, 3761 
(1985). 

[53] M. J. CoUett and C. W. Gardiner, Phys. Rev. A 30, 1386 
(1984). 

[54] T. A. Brun, Am. J. Phys. 70, 719 (2002). 
[55] K. Jacobs and D. Steck, Contemp. Phys. 47, 279 (2006). 
[56] H. M. Wiseman and G. J. Milburn, Phys. Rev. A 49, 
1350 (1994). 

[57] H. M. Wiseman and G. J. Milburn, Phys. Rev. A 49, 
4110 (1994). 

[58] E. Hendricks, Ol Jannerup, and P. H. S0rensen, Linear 
Systems Control, (Springer- Verlag, 2008). 

[59] J. P. Hespanha, Linear Systems Theory, (Princeton Uni- 
versity Press). 

[60] It is interesting to note that some engineers were already 
curious about such questions much earlier [35l - l37l |. 

[61] In general the square root of a matrix A is any matrix B 
such that B = A. When A> 0, there exists a unique B 
such that B > and B^ = A, called the positive square 
root of A. The positive square root of A is denoted by 

Va. 

[62] Note however that Ul^f^^hinUn^[b / Ul^houtUih- 



